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Description 

FIELD OF THE INVENTION 

s The present invention pertains to the field ot voice processing. More particularly, the present invention relates to a 

mechanism for integrating voice messaging with an electronic text messaging system. 

BACKGROUND OF THE INVENTION 

10 Since the advent of telephone communications, callers have frequently failed to make contact with the person they 

are calling either because that person is on another line, away from the phone, or otherwise preoccupied. Time and 
effort are wasted by playing telephone tag. This problem is especially acute in the business environment as customers 
are faced with unanswered calls, extended waits on hold, unconveyed important information, etc. Communication within 
an organization between employees is also a problem because of availability at the same time of the people who need 

'5 to communicate. Time zone differences, especially in regards to international calls, particularly aggravate this issue. 

Traditionally, a caller who cannot get hold of the person they are trying to contact could leave a message with a 
receptionist or secretary. However, written messages are notoriously prone to inaccuracies and are practically limited 
in length. Furthermore, this approach only works during business hours when the receptionist or secretary is available 
to pick up the incoming call. 

20 in response to the shortcomings of handwritten messaging, electronic voice and text messaging systems have been 

developed. A number of voice and text messaging systems are known in the art and are commercially available. A voice 
messaging system is used to automate the answering of incoming calls from the outside telephone network and the 
taking of messages when the extensions are not answered by the called parties. Voice message systems are also used 
for people using any standard DTMF (Dual Tone Multi-Frequency) phone to call the voice message system and create 

25 messages that are then addressed and sent to one or more select other users of the system. Such voice messaging 
systems incorporate features, such as the recording of voice messages for users in what are known as "mailboxes" 
Commonly, voice messaging systems may also be accessed by users calling from PBX extensions or from the telephone 
network over incoming trunks to access their mailbox to listen to voice messages. 

In most known voice messaging systems, answering of incoming trunk calls by the voice messaging system is 

30 accomplished by instructing the PBX to direct the incoming calls to a group of extensions. Voice ports of the voice 
messaging system are coupled wilh this group of extensions and appear to the PBX simply as single line telephone 
sets in a hunt group. Typically, the voice messaging system will answer a call directed to it and provide a pre-recorded 
voice message allowing the caller to "log-on" (i.e., enter a user identification number and security code) to access their 
mailbox in order to listen to or send voice messages. Internal users on the PBX can directly call the group of extensions 

35 in the hunt group to access the voice messaging system. 

In addition to handling calls received by the PBX from incoming telephone trunks and direct internal calls, an im- 
portant function of known voice messaging systems is the handling of calls which do not successfully reach the originally 
intended extension either because the extension was busy, did not answer, or had intentionally been placed in a mode 
in which it was not accepting calls. Such a function may be accomplished in known voice messaging systems by in- 

40 structing the PBX to toward all such unanswered calls to a group of extensions coupled with the voice ports of the voice 
messaging system. As is know in the prior art, for example U. S. Patent No. 4,926,462, voice message systems are 
also connected to the PBX in such a way as to receive information about the originally called extension number so that 
the voice message system can answer the call with the greeting of the called party and take a voice message that goes 
into the voice mailbox for that called person. 

45 Another mechanism which has been used for the transmission and receipt of text messages involves computers. 

With the advent of personal computers and workstations, computing power was distributed to users at the desktop level. 
As is well know in the prior art, these personal computers (PCs) and workstations can be connected using Local Area 
Network (LAN) and Wide Area Network (WAN) hardware and software technology. 

The interconnection of PCs and workstations into networks is becoming increasingly popular and one of the most 

so common applications is that of electronic mail (E-mail) E-mail allows users to compose, send, and receive messages 
on their PCs or workstations over a LAN or WAN. Originally, E-mail systems only handled text-based messages. In- 
creasingly, they are being enhanced to also support the transmission of other formats of information, such as graphics, 
spread sheets, facsimile, and voice. 

Most of the E-mail systems available for PC network environments require a file server computer on the LAN. The 

55 most popular file server LAN software system is sold by Novell™ (Netware™) or Microsoft™ (LAN Manager™). These 
software systems allow programs on individual PCs to access files on a computer running the file server software. These 
files can either be shared access or assigned to a particular individual. They also support what are called "peer-to-peer" 
communications protocols, which allow PCs to send and receive data to and from other PCs on the LAN. 
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The E-mail software running on a particular user's PC uses a file server on a LAN as the "post office" for the mail 
message As an example, there is a shared file on the server that is the "user directory". It has information such as each 
users' E-mail addresses and passwords. The file server is also where the messages are stored when they are waiting 
to be accessed by a user. The server also contains information for each user regarding how many messages they have, 

s the date and time of creation of each message, who it is from, who else was copied, etc. This information is sometimes 
called a message header or "envelope" information. Also supported in these E-mail systems is the ability to send E-mail 
messages to other E-mail systems located on a different LAN (usually via a dedicated WAN connection or via dial-up 
modems). In these cases there is software running on one of the PCs on the LAN that handles the moving of messages 
and of all the message header information from one file server via the WAN to another file server. There is also software 

io that keeps the directories of these different LAN based E-mail systems automatically updated. 

As indicated previously, the E-mail systems also support the ability to attach other files that are stored on the server 
as part of the E-mail message. In some E-mail systems, the names of these attached files might also be part of the 
message header information. These E-mail systems typically have available Application Program Interfaces (APIs) which 
allow software programs to be written to use the E-mail directory, message handling, user access and security mecha- 

15 nisms of that particular E-mail system for facilitating the development of other applications. The two most common LAN 
based E-mail systems are Microsoft Mail™ and Lotus cc:Mail™. Microsoft™ supports a set of APIs called Messaging 
Application Program Interface (MAPI) and Lotus™ supports, as do other software companies, APIs called Vendor In- 
dependent Messaging (VIM). 

In prior art voice messaging systems, the methods for keeping track of user directories, message header information, 

20 and the messages themselves is unique to each manufacturer. Virtually all these methods are different from the methods 
the E-mail software systems use to perform the same functions for E-mail. This means that a business organization that 
has both E-mail and voice messaging must maintain two user directories, two mailboxes per user, and two wide area 
networking and directory update systems. This is both inconvenient for the users and more expensive to manage for 
the business. 

2B In Speech Technology, Man-Machine Voice Communications, vol. 4, no. 2, March 1 988, New York, USA, pages 84 

- 87, the article "Meridian Mail Voice Mail System Integrates Voice Processing and Personal Computing" by D.W. Cole- 
man discuses a voice mail system based on personal computers that allows the control (store and playback) of voice 
messages received via telephone lines while related information (sender, priority, subject tag) can be produced and/or 
displayed and on the personal computer. This system does not provide for the handling of text and voice messages, 

30 but for the handling of voice messages only. 

WO 92/1 431 4 discloses a communication networkfor creating, storing, recalling, and revising compound documents 
containing text, data, image, video, and audio, and manipulating the electronics representations of these compound 
documents. This network provides means for supporting delivery and presentation of these compound documents and 
composite objects by integrating otherwise-independent digital and audio communications networks. It permits a user 

35 to make voice comments and insertions using telephone, at a specific location in a compound document maintained in 
a digital network and viewed on a work station terminal. Audio portions of compound documents are heard with their 
original sound. The system includes a digital network for communicating digital information throughout the digital network. 
The digital network includes several work stations to gain access to the digital network. The system also includes an 
audio communications network for communicating audio information throughout an audio communications network. The 

40 digital network includes a local area network. The audio communications network includes a local area telephone system, 
having handsets available at the work stations. The communications system also includes a digital network server within 
the digital network for processing digital information in the digital network. The digital network server is in communication 
with the work stations through the digital network and has a digital data storage. An audio communications network 
server within the audio communications network processes an electronic representation of audio information in the audio 

45 communications network. The audio communications network server is in communication with the audio input/output 
device through the audio communications network. An audio data storage for storing an electronic representation of 
audio information is provided in either the digital network means, the audio communications network means, or both. 

US 5,008,926 discloses a message management system which incorporates an integrated voice and image store 
and forward apparatus. The message may include a visually sensible portion and an aurally sensible portion. There is 

50 provided a control apparatus for transmitting the message to a selected subscriber and there is provided an apparatus 
for providing notification to the selected subscriber of the arrival of a message. The apparatus for producing a message 
comprises telephone apparatus and image transmission apparatus. The image transmission apparatus comprises a 
facsimile apparatus or any other suitable apparatus for transmitting images, i.e. text or other suitable images. The images 
are stored in digital form. The message management apparatus comprises an apparatus for providing a store and forward 

55 function, and an interconnect subsystem to interconnect with a telephone switching apparatus and an image transmis- 
sion apparatus, a control subsystem for providing control instructions to the interconnect subsystem apparatus including 
instructions for transmitting and receiving image transmissions and voice messages and instructions for providing voice 
messages relating to such image transmissions and mass storage subsystem apparatus coupled to the control subsys- 
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tem for storing voice and image transmissions. The image is stored in digital form. A mass storage subsystem is provided 
for storing voice messages, images, and messages combining voice and images to be forwarded. 

WO 87/07801 discloses a message delivery system for a plurality of users which exchange voice or data messages 
with one another. These messages are forwarded to the message recipient. The system is controlled by potential mes- 
sage recipients for designating either the recipient's voice terminal or the recipient's data terminal as the prime message 
receptor. The prime message receptor receives notifications of the arrival of either voice or data messages and the 
prime message receptor controls the receipt of each notification for alerting the recipient of the received notification. 

GB-A-2 150 326 discloses a voice/text storage system for the storage of digital data and digitized voice signals. 
The system includes a first bus connecting a storage/network processor which controls access to a mass storage device, 
a host processor which provides overall control for the system and a communications processor. All processors have 
private memories connected to the processor CPU's directly so that the processors may continue to operate when the 
first bus is busy. The system also includes a second bus connecting the storage/network processor, a voice transfer 
control unit, a buffer and voice transfer unit, for receiving, digitizing and storing voice signals received over a plurality 
of telephone lines. The voice transfer unit also includes a switch and data carrier detection apparatus for selectively 
connecting digital data signals transmitted over the telephone lines to the communications processor. 

EP 0 339 476 A2 discloses a system to compile messages comprising voice and non-voice portions. A voice terminal 
and a data terminal for the non-voice portion are accessible through the same user port. Voice messages and non-voice 
messages are stored on and retrieved from different storage media in the system. 

Therefore, there exists a need in the prior art for an integrated voice and text electronic messaging system. Such 
an integrated system would allow companies to maintain only one directory for all voice and E-mail users, maintain only 
one method of wide area networking both kinds of messages, and give the users only one mailbox to check and use 
for all types of messages (e.g., voice, fax, text, graphic, etc.). 

SUMMARY OF THE INVENTION 

In 1he present invention, the APIs of a commercially available E-mail system and the ability to attach voice files as 
part of an E-mail message are used to implement a voice messaging system. The voice file is created by using a board 
in a PC which connects to a phone system to accept incoming phone calls and to convert the analog voice signal into 
a digital format. For the purposes of this disclosure this will be called the voice gateway PC. Conversely, the digital 
30 format is converted back to the analog voice signal for playback of a stored voice file. A voice message is recorded by 
storing the digital voice data on the file server using a uniquely created file name. To send a voice message, the voice 
file stored on the server is attached to an E-mail message and "sent" using the appropriate API. For receiving a voice 
message, the voice file attached to an E-mail message is retrieved and transferred to the gateway PC. Thereupon, the 
board which is connected to a phone system converts the voice file from a digital format to an analog voice signal for 
35 playback over the phone line. 

There are three methods of creating and sending voice messages. In the first method, a user at his PC can elect 
to send an E-mail message by using the standard E-mail message software. But instead of just typing in the text of a 
message, he can access another application running on his PC to send a peer-to-peer message to the voice gateway 
PC on the LAN. The voice gateway PC is connected to the phone system so that it can call the phone associated with 
40 the user's PC in order to record a voice message. When he answers the phone, the gateway PC records his voice 
message using the voice board and writes the digitized voice data onto the file server with a unique file name and 
attaches that file name to the E-mail message that is waiting to be sent. 

In the second method, an unanswered call to a particular user's phone will be forwarded to a phone port of the voice 
gateway PC. The PBX informs the PC of that particular extension which did not answer. The voice gateway PC converts 
45 the extension number to an E-mail address, plays a personal greeting file pre-recorded by the user, and records the 
caller's voice message onto the server. It will then select the appropriate E-mail APIs necessary for sending an E-mail 
with the attached voice file to the user's E-mail address. 

In the third method, a user directly calls the voice gateway PC. By using signals from his DTMF phone, which are 
translated by the phone interface board on the PC to digital signals, the user enters his extension number and E-mail 
so password in order to "log-on" to his mailbox. Note that the E-mail password must have been set to all numeric digits if 
it is to be the same as used directly by the voice message phone user. However, it would be possible for the voice 
message user to enter an alphabetic password using multiple numeric digits to represent the selected alphabetic char- 
acter. The user can then send commands from his DTMF phone to create the voice message which will be stored on 
the server and also to address voice messages using the recipient's voice mailbox number. The voice gateway PC 
55 software uses the APIs to send the voice files to the appropriate E-mail user. 

There are two methods for retrieving voice messages. In the first method, when a user views his E-mail "inbox" on 
his PC, some of the messages may contain voice files as a result of any of the three sending methods above. If the user 
opens such a message and "selects" the voice file attached, the software running on his PC recognizes that the file 
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name is of a particular type. Thereupon, it activates a software application on the PC which sends a command (using 
peer-to-peer communication) to the voice gateway PC to ring the user's phone and to play the voice file selected. 

In the second method, the user calls into the system from a DTMF phone directly to the voice gateway PC. As 
described above, the user logs-on to his mailbox via the phone. The voice gateway PC software selects the appropriate 
5 APIs to search the user's E-mail message for attached voice files. The APIs also can be used to obtain information from 
the user's E-mail mailbox regarding the number of messages which have voice attachments. The voice gateway PC 
can speak this count to the telephone user, and allows the user to play a voice file through the use of DTMF buttons on 
the telephone. Other standard voice messaging features such as save, erase, forward, reply, etc., are also supported. 

ro BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example, and not by way of limitation, in thefigures of the accompanying 
drawings and in which like reference numerals refer to similar elements and in which: 

Figure 1 shows a client-server system architecture upon which the present invention may be practiced. 
15 Figure 2 shows a flowchart describing the steps for a caller logging into his or her mailbox using an E-mail system. 

Figure 3 shows a flowchart describing the steps for providing a caller with a message summary for review of his 
or her messages. 

Figure 4 is a flowchart showing the steps for scanning the mailbox of the caller for a voicemail system which is 
integrated with MAPI E-mail systems. 
20 Figure 5 is a flowchart describing the steps for message playback of new messages of a voicemail system integrated 

with MAPI E-mail systems. 

Figure 6 is a flowchart describing the steps for message playback of saved/old messages of a voicemail system 
integrated with MAPI E-mall systems. 

Figure 7 is a flowchart describing the steps for sending a message from one user to another over the telephone 
25 with MAPI E-mail systems. 

Figure 8 is a flowchart describing the steps for a call answering operation with MAPI E-mail systems. 

Figure 9 is a flowchart showing the steps for saving and deleting messages and marking messages as read With 
MAPI E-mail systems. 

Figure 10 is a flowchart showing the steps for replying to a message during message playback with MAPI E-mail 
30 systems. 

Figure 1 1 is a flowchart showing the steps for scanning the mailbox of the caller using the VIM (Vender Independent 
Messaging) APIs supported by Lotus cc:Mail. 

Figure 12 is a flowchart showing the steps for message playback of new messages with a VIM type E-mail system. 

Figure 13 is a flowchart showing the steps for sending a message from one user to another over the telephone 
35 with a VIM type E-mail system. 

Figure 14 is a flowchart showing the steps for a call answering operation with a VIM type E-mail system. 

Figure 1 5 is a flowchart showing the steps for marking as read and deleting messages for a VIM type E-mail system 

Figure 16 is a flowchart showing the steps for replying to a message during message playback with a VIM type 
E-mail system. 

40 Figure 17 shows a computer display as may be implemented for an integrated voice and electronic mail system. 

DETAILED DESCRIPTION 

An integrated voice and electronic mail system is described. In the following description, numerous specific details 
45 are set forth such as specific APIs, prompts, menus, software code, subroutine calls, etc., in order to provide a thorough 
understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention 
may be practiced without these specific details. In other instances, well-known structures and devices are shown in 
block diagram form in order to avoid unnecessarily obscuring the present invention. 

The present invention applies to a computer network-based voice processing system. A network of personal corn- 
so puters, workstations, servers, hubs, concentrators, routers, bridges, etc., is coupled to and interfaces with a standard 
telephone system in order to create, send, and receive voice messages as well as electronic mail messages according 
to a single integrated message handling mechanism. The present invention also allows for access of messages from a 
remote phone. The present invention also allows for the taking of a voice message as the result of an unanswered phone 
call and the putting of that voice message into a designated user's E-mail mailbox. 
55 Referring to Figure 1, a client-server system architecture upon which the present invention may be practiced is 

shown. A number ol phones 101 A-C are connected to a local PBX 102. PBX 102 has several trunks 110-112, which 
provide transmission of analog voice signals to and from the local telephone network. Also coupled to PBX 102 is voice 
gateway 103. Voice gateway 103 is additionally coupled to a LAN 105 which in turn also connects a file server 106 and 
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PC workstations 107-109. The file server provides disk (or disks) 106B for storage use by the computers on the LAN. 
Voice gateway 103 is a computer with voice processing and network interface cards such as those available from Dia- 
logic™ or Rhetorex™ Corporation. The voice gateway 103 is connected via lines 104a to PBX 102. There may also be 
an additional connection between voice gateway 103 and PBX 102 that is the PBX Integration Link 104B for providing 

s information when an unanswered call is forwarded to one of the lines 1 04A on the original called extension number. 

An E-mail software package, such as Microsoft Mail™ or Lotus cc:Mail™, is installed on the PCs 107-109 and on 
the voice gateway PC 103. Thereby, E-mail capabilities are provided for each of the PCs on LAN 105. The file server 
106 is used as the "post office" for the E-mail system. In an alternative embodiment, the present invention is applicable 
to wide area networks (WANs) using the E-mail software packages available to provide messaging capabilities across 

io different LANs. That is, for workstations and PCs connected on a LAN with a file server the two LANs are interconnected 
using commercially available routers, bridges, or gateways. 

Software in the voice gateway 103 uses the voice processing cards connected to PBX 102 to convert analog voice 
signals to digital signals and sends the digital signals to file server 106 to be stored on its disk drive 106b. For playing 
voice messages the voice files stored on the file server disk 106B are retrieved and sent to the voice gateway 103 to 

is be converted by the voice processing cards from digital data to analog data. Furthermore, voice cards implemented in 
a PC, can also send DTMF digits to dial a phone number, decode DTMF digits as commands, detect calls ringing in, 
answer calls (i.e., go off-hook), flash to indicate to the phone system a request for a PBXf unction (e.g., transfer), hang-up, 
etc. 

The voice gateway 103 can be called directly by one of the phones 101A-C or can call one of the phones 101A-C 

20 to play or record voice messages. The voice gateway 103 can also be accessed directly by a call coming in on a trunk 
110-112 being connected via lines 104a to the voice processing cards in voice gateway 103. As indicated previously, 
calls to phones 101 that are not answered can be forwarded by the PBX 102 to one of lines 104A and Information about 
the extension number of the phone 1 01 A-C is transferred via link 1 04B to the voice gateway. 

The integralion of voice messaging with an E-mail system is accomplished in part through the use of Application 

25 Program Interfaces (APIs). An API defines the sets of standard (unction calls to interface to the messaging system that 
can be invoked from an application program. Basically, an API is comprised of a group of subroutines that allows pro- 
grammers to write code for using the E-mail directory, E-mail message handling mechanisms, E-mail security systems, 
etc. , that already exist for most E-mail systems. By taking advantage of the APIs, access is gained to an E-mail system's 
directory and message handling mechanisms so as to integrate voice messages with the E-mail system. In other words, 

30 a developer can write code for modifying the interface for an E-mail system so as to include voice messages. In this 
way voice files may be managed equally as well as text files, or other attachment files. 

Among the APIs are the "Messaging Application Program Interface" (MAPI) promoted by Microsoft used for inter- 
facing to Microsoft Mail™ and other MAPI compliant e-mail products; and "Vendor Independent Messaging" (VIM) pro- 
moted by Lotus and others for interfacing to Lotus cc:Mail™ and other VIM compliant e-mail products. Table 1 below 

35 lists the MAPI and VIM APIs used for implementing the voice messaging functions previously described. There are now 
and may be in the future other E-mail API's that one ol ordinary skill could use to produce the invention. These are given 
only as methods for two embodiments of the present invention. In the following description, digitized voice files are 
identified by the four character extension. vox. 

40 
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TABLE 1: 



PC/Workstation Software Operations 



What's happening 


MAPI call 


VIM API call 


Record a message and 
then press the mail 

huttAii 

uuLion 


MAPISendDocumen 
ts 


SMISendMail 


Listen to voice 
messages found in 
the user's mail 
folder/In Tray Inbox 


No spedal API 
function required - 
autoloads special 
application on the 
PC based on 
association to .VOX 
extension 


No spedal API 
function required - 
autoloads spedal 
application on the 
PC based on 
association to .VOX 
extension 



General Housekeeping 



What's 
happening 


MAPI call 


VIM API call 

r 


Administration 






Assign voieemail 
box numbers 
and passwords; 
also default 
telephone 
extensions 
required for 
'Connect to 
Sender'. 


A template that 
has two additional 
fields 

Voice mailbox 
Number' and 
'Default Telephone 
Extension 1 Is 
defined. 

The standard Mail 
address book form 
has two 'Phone 
Number' fields. 
The 'Phone number 
#2 is used as the 
Voice mailbox 
number, and Phone 
number #1 is the 
extension number. 


Use the cc:Mail Admin 
(DOS) program to create 
aliases for existing 
users. These aliases 
contain the mailbox 
number as the name, 
the tdephone extension 
in the comments field 
and user name in the 
address field. 
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Voice Gateway 
User Table 
Creation. The 
User Table is 
created 

periodically and 
is updated every 
time the Voice 
Gateway is 
restarted. 


A text file 
containing the 
MAPI address book 
Is created using the 
MS-Mail 
template.exe 
utility, which is 
read into memory. 
This contains the 
required 

information about 
the users. 


VTMGetDefaultSessionI 
nfo 

VIMOpenSession 

VIMOpenAddressBook 

VIMEnumerateAddress 

BookEntries 

VTMGos eAddressBook 

VIMaoseSession 


General Session 
Management 


InitMAPI 
MAPILogon 
MAPILogoff 
DelnitMAPI 


VIMInitialize 
VIMOpenSession 
VIMCloseSession 
VIMTerminate 



PBX Integrated Call Answering • 



What's 
happening 


MAPI call 


VIM API call 


Call forwards to 
Voice Gateway 
with called 
extension 
number 
information 


Look up the 
extension 
number in the 
user table 
created at start- 
up to get E-mail 
Mailbox number. 


Look up the extension 
number in the user table 
created at start-up to get 
E-mail Mailbox number. 


External caller 
records message 
for the called 
extension user. 
Need to send 
voice file to the 
users E-mail 
address. 


MAPILogon 

MAPISendMail 

MAPILogoff 


VIMGetDefaultSessionlnfo 

VIMOpenSession 

VIMCreateMessage 

VIMSetMessageHeader 

VIMSetMessageRecipient 

VIMSendMessage 

VIMaoseSession 
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User Calls In to Listen to Messages 



User calls Voice 
Gateway to 
check voice 
messages. User 
enters Voice 
mailbox 
number and 
password. 


Check name 
from user table. 
Check password 
using 

MAPILogon 


Check name from user 
table. Check password 
using VTMOpenSession 


Count and 

acrpss vnirp 

files. 


MAPIFindNext 
MAPIReadMail 
(look for .vox 
ffles) 

MAPIFreeBuffer 
MAPILogoff 


VlMOpenMessageContainer 

VIMEnumerateMessaffes 

VIMOpenMessage 

VIMEnumerateMessagelte 

ms (look for .vox files) 

VIMGetMessageltem 

VIMCloseMes$age 

VIMaoseMessageContainer 

VIMQoseSession 


Tell User how 
many voice 
messages. 


All .vox files 
found above 
have been 
extracted from 
their messages 
and their 
filenames are 
sent to the Voice 
gateway PC for 
playing back 


All .vox files found above 
have been extracted from 
their messages and their 
filenames are sent to the 
Voice gateway PC for 
playing back. 


Listen to 
messages 


MAPIReadMail 
(without the 
MAPI _PEEK 
flag) 

MAPIFreeBuffer 


VlMOpenMessageContainer 

VIMMarkMessageAsRead 

VIMQoseMessageContainer 
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Message Playback Opt 


Ions 


What's happening 


MAPI call 


VIM API call 

nrniHiramiriwffifflnroriHiiii i iiiiiiiiiiiiiiiii vmimmmvrwm 
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Figures 2-1 6 are flowcharts illustrating the steps for implementing the present invention. The following conventions 
are used in these flowcharts: a rectangular box indicates information enlered by an outside caller; a diamond indicates 
a conditional branching; an oval indicates internal voice message system operation or a function call: and a rectangle 
having rounded comers indicates a message being played to the caller. Phrases in quotation marks are typical of the 
system message played to the caller at this point. In particular, the flowcharts of Figures 4-10 are directed towards the 
steps of implementing the present invention on MAPI E-mail systems, while the flowcharts depicted in Figures 11-15 
are directed towards VIM E-mail systems. 

As indicated in Table 1 , under "General Housekeeping," Ihere are some functions performed for setting up the E-mail 
system user directory to handle voice messages and also by the voice gateway PC to create special tables to facilitate 
certain feature implementations. In order to use the E-mail directory, the user voice mailbox and extension number need 
to be assigned and associated with their E-mail identification. In many cases, the extension number and voice mailbox 
may be the same, and thus, only one entry is needed. In either case, the voice gateway PC scans the E-mail directory 
and builds a table (herein called the "User Table") which can be searched using the voice mailbox or extension number 
to determine an E-mail identification called E-mail name. This User Table is referred to in the flow charts. 

Referring now to Figure 2, a flowchart describing the steps for a caller logging Into his or her mailbox is shown. 
Initially, the computer prompts the caller to enter his or her mailbox number, step 201. Prompts are pre-named voice 
files that are stored either on the file server or voice gateway and are read off disk storage and sent to the voice processing 
cards to be converted from digital data to analog data to be played. Thereupon, the caller enters his or her assigned 
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voice mailbox number, step 202. For this and other functions, the user "enters" numbers using a standard DTMF phone 
key pad. The tones received by the voice processing cards in the gateway PC are converted to their corresponding digit 
* or # representations and made available to the voice gateway PC for processing. The voice gateway PC searches for 
the User's name from the User Table stored in memory, step 203. If there is no match, a voice message such as "Sorry, 
that is not a valid mailbox number, 11 will be played to the caller, step 208. 

Otherwise, if the mailbox number is valid, the computer system prompts the user to enter his or her password, step 
204. In response, the caller enters the password, step 205. The user name and password is sent to a subroutine (e.g., 
MAPILogon or VIMOpenSession) to determine whether that password correctly matches with the user name, step 206. 
If the password is invalid, the computer sends a voice message such as "Sorry, that is not the correct password," to the 
caller, step 209. The computer reprompts the caller to enter his password, step 204. If a valid password has been entered, 
the mailbox of the caller is scanned, step 207. The scanning step is described in detail below in reference to Figure 4 
for MAPI applications and to Figure 11 for VIM applications. 

Figure 3 shows a flowchart describing the next steps for providing a caller with a message summary for review of 
his or her messages. The message count is used to determine the prompt about mailbox message information, step 
302. Depending on the message count, there can be three outcomes. If there are no messages, the caller is so informed, 
step 303. The computer system then prompts the user to press "*" to record a new message, step 306. A new message 
is recorded if the user proceeds to press "*" and leaves a message, step 307. The steps for sending a message is 
described in detail below in reference to Figure 6 for MAPI applications and to Figure 10 for VIM applications. If there 
are new messages, the computer system will inform the user of the number of new messages as well as the number of 
old messages, step 304. The messages are then played back, step 308. The steps for message playback of new mes- 
sages is described in detail below in reference to Figure 5 tor MAPI applications and to Figure 12 for VIM applications. 
Once message playback is completed, the computer system indicates that there are no more new messages, step 309. 
At that point, the user can press "#" to listen to his or her old messages, step 31 1 . If the user does press the "#" symbol, 
the old messages are played back, step 312. The steps for message playback of old messages is described in detail 
below in reference to Figure 6 for MAPI applications and Figure 1 2 for VIM with step 1 204 modified to reverse the path 
for "yes" and "no" 

If there are no old messages, the computer system so informs the caller, step 310. If there are no new messages, 
the computer system informs the caller of this status as well as the number of old messages, step 305. If there are no 
old messages either, then the computer system indicates that the caller has no more messages, step 310. Otherwise, 
the user can press the "#" symbol to listen to his or her old messages, step 311. Pressing the "#" symbol causes the old 
messages to be played back, step 312. 

Figure 4 is a flowchart showing the steps for scanning the mailbox of the caller for a voicemail system which is 
integrated with a MAPI E-mail system. In step 401, the MAPIFindNext subroutine is used to get the next mail message. 
Next, the MAPIReadMail subroutine is used to get information about the message, step 402. A determination is made 
as to whether there are any voicemail attachments, step 403. If so, a count is incremented of the new and old messages, 
step 404. The algorithm proceeds to step 405. If there are no voicemail attachments, a determination is made as to 
whether there are any more messages, step 405. If there are more messages, step 401 is repeated. Otherwise, the 
MAPILogoff subroutine is executed to end the session, step 406. 

Figure 5 is a flowchart describing the steps for message playback of new messages of a voicemail system integrated 
with MAPI E-mail systems. In 501 , the user name and password is provided to the MAPILogon subroutine. The MAPI- 
FindNext subroutine is used to get the next mail message, step 502. Next, the MAPIReadMail subroutine is used to get 
the information about that message, step 503. A determination is made as to whether this is a new message, step 504. 
If so, a determination is then made as to whether there are any voicemail attachments, step 505. If it is determined that 
there are voicemail attachments, the .vox files are extracted from the message, step 506. 

The extracted .vox file is played by using the message playback options, step 507. If ft is determined in steps 504 
and 505 that either this is not a new message or that there are no voicemail attachments, step 508 is performed imme- 
diately. If it is determined in step 508 that there are no more messages, the MAPILogoff subroutine is used to end the 
session, step 509. Otherwise, step 502 is repeated to get the next mail message. Note that this flowchart shows message 
playback for new messages. 

Figure 6 is a flowchart showing the sleps for playback of saved or old messages. In step 601 , the user name and 
password is provided to the MAPILogon subroutine. The MAPIFindNext subroutine is used to get the next mail message, 
step 602. Next, the MAPIReadMail subroutine is used to get the information about that message, step 603. A determi- 
nation is made as to whether this is a saved or old message, step 604. If so, a determination is then made as to whether 
there are any voicemail attachments, step 605. If it is determined that there are voicemail attachments, the .vox files are 
extracted from the message, step 606. 

The extracted .vox file is played by using the message playback options, step 607. If it is determined in steps 604 
and 605 that either this is not a saved message or that there are no voicemail attachments, step 608 is performed 
immediately. If it is determined in step 608 that there are no more messages, the MAPILogoff subroutine is used to end 



11 



EP0 631 419 B1 



the session, step 609. Otherwise, step 512 is repeated to get the next mail message. 

Figure 7 is a flowchart describing the steps for voice message users to send a message to another user over the 
phone. In step 701, the user is prompted to enter the voice mailbox number of the recipient. The user then enters the 
voice mailbox number of the recipient, step 702. The computer system locates the recipient E-mail name from the stored 
s user table, step 703. If it is determined that the mailbox number is invalid, a voice message such as "Sorry, this is not 
a valid mailbox number. Press * to try again orOto return to the start," is sent to the caller, step 711. If it is determined 
that the mailbox number is valid the system plays a prerecorded message such as "Record your message after the 
tone," step 704. 

A new f ile is created on the file server with a file name that is uniquely created and has ".vox" as its last 4 characters 

io and the system transfers the digitized voice signal to this file, step 705. The user indicates he is finished recording by 
entering a #, step 706. In step 708, the call to MAP I Logon is used with the sending user's E-mail name and password 
(so he will appear as the originator of the message). In step 709 : the MAPISendMail subroutine is used to send the 
created voice file with .vox in its file name attached to an E-mail message to the recipient using the E-mail name previ- 
ously determined from the mailbox number. A MAPI Logoff subroutine is used to end the session, step 710. 

is The flowchart of Figure 8 shows the steps for a call answering voice message operation using MAPI. The called 

party's extension is forwarded to the voice message system ports, and the PBX provides integration information along 
with the call, including giving the called party's extension number. In step 801 , the extension number received from the 
PBX is used to find the called party's E-mail name from the User Table. In step 802, the system plays a personal greeting 
previously recorded by the user of the called extension (or a delault message if none is recorded - such as "Extension 

20 xxxx did not answer"). Step 803 shows the creation of a new file name with a .vox extension (to indicate it is a voice file) 
and the writing of digitized voice data into the file. Recording is terminated when the user hangs-up or on the detection 
of silence, special tones, or a timeout and control proceeds to step 804. 

If the forwarded call is from another extension on the same PBX, some PBX integrations also give the calling party's 
extension number as well as that of the called parry. Step 804 checks to see if the caller extension has an entry in the 

25 User Table. In Step 805, the decision is made to go to step 806 if there is an entry and it is a known user or to step 807 
if it is not. In step 806, The FFAPI gtwpul subroutine is used with the administrator password to create message from 
Caller or equivalent MAPI functions. In step 807, a default name (for example, "External") and password is used as the 
originator of the message. Then MAPISendMail is used to send the .vox file, step 808, and MAPILogoff is used to end 
the session, step 809. 

30 Figure 9 is a flowchart showing the steps for marking as read, saving, and deleting messages. Initially, the caller 

instructs the computer system to either mark a message as read, save a message, or delete a message, step 901. A 
call is made to the MAPI Logon subroutine with the user name and password, step 902. A call is made to one of three 
different subroutines depending upon the caller's instruction, step 903. A call is made to the MAPIReadMail subroutine 
for marking the messages as read. The MAPI SaveMail subroutine is utilized for saving a message. The MAPIDeleteMail 

35 subroutine is used for deleting a message. MAPILogoff is used to end the session, step 904. 

Figure 1 0 is a flowchart showing the steps for replying to a message during message playback for MAPI applications. 
Initially, a determination is made as to whether the original sender is known, step 1001. If so, the process jumps to step 
1006. Otherwise, step 1 002 prompts the user is prompted to "Please enter the Mailbox Number." In step 1003, the caller 
enters the voice mailbox number of the recipient. The user name is then located from the user table, step 1004. If it is 

40 an invalid mailbox number, step 1005 informs the user, "Sorry that is not a valid Mailbox Number. Press * to try again 
or 0 to return to the start." And step 1002 is repeated. If the mailbox number is valid, step 1006 gives a personal prompt. 
If this does not exist, the computer transmits, "Please leave your message after the tone." In step 1007, a new .vox file 
is created, and the digitized voice is written to it. The sender's and recipient's names are located from the user table, 
step 1008. The MAPI Logon subroutine is used with the sender name and password, step 1009. The .vox file is then 

45 sent to the recipient by using the MAPISendMail subroutine, step 1010. MAPILogoff is used to end the session, step 1011 
Figure 1 1 is a flowchart showing the steps for scanning the mailbox of the caller to get the count of new and saved 
messages in E-mail systems using VIM. Initially, the VIMOpenMessageContainer subroutine is used to open the Inbox 
of the caller, step 1101. The VIMEnumerateMessage subroutine is used to retrieve the caller's next mail message, step 
1102. Given that a mail message has been found, VIMOpenMessage subroutine is used to open that mail message, 

so step 1 103. The VIMEnumerateMessageltems subroutine is used to find the next file attachment in that message, step 
1 1 04. A determination is made as to whether the attachment is a .vox file, step 1 1 05. If so, a count is kept of this voicemail 
message, step 1106. Following step 1106 or if it is determined that the attachment is not a .vox file, a determination is 
made as to whether there are any more attachments in that message, step 1107. If there are more attachments, step 
1104 is repeated. Otherwise, the VIMCIoseMessage subroutine is used to close this mail message, step 1108. Adeter- 

55 mination is made as to whether there are any more messages, step 1109. If there are more messages, then step 1102 
is repeated. Otherwise, the VIMCIoseMessageContainer subroutine is used to close the Inbox ol the caller, step 1110. 

Figure 1 2 is a flowchart showing the steps for the playback of new messages using VIM. Initially the VIMOpenMes- 
sageContainer is used to open the Inbox of the caller, step 1201. The VIMEnumerateMessages subroutine is used to 
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get the next mail message, step 1202. Once the next mail message has been found, it is opened by implementing the 
VIMOpenMessage subroutine, step 1203. A determination is made as to whether this is a new message, step 1204. If 
it is determined that this is a new message, the VIMEnumerateMessagesltems subroutine is used to find the next file 
attachment in the current message, step 1205. 

5 A determination is made as to whether the attachment is a .vox file, step 1206. If so, the VIMGetMessageltem 

subroutine is used to extract the .vox file from the message, step 1207. The extracted .vox file is played back by using 
the message playback options, step 1208. If It is determined in step 1206 that the attachment is not a vox file, then 
steps 1207 and 1208 are skipped and the determination of step 1209 is performed. If there are more attachments in the 
message, step 1 205 is repeated. Otherwise, the VIMCIoseMessage subroutine is used to close this mail message, step 

10 1210. In step 1211, a determination is made as to whether there are any more messages. If so, step 1202 is repeated. 
Otherwise, the VIMCIoseMessageContainer subroutine is used to close the Inbox of the caller, step 1212. Not shown 
for VIM is the play back of saved messages. As for MAPI shown in Figure 5b, it simply changes step 1204 in Figure 12 
to look for "old/saved" messages instead of new. 

Figure 1 3 is a flowchart showing the steps for sending a message from one user to another over the phone in E-mail 

is systems using VIM. The caller is prompted to "Please enter the mailbox number", step 1301. The caller enters the voice 
mailbox number of the recipient, step 1302. The computer system looks up the recipient E-mail name from the stored 
user table, step 1 303. If the mailbox number is invalid, the caller is sent a message such as "Sorry, that is not a valid 
mailbox number. Press * to try again or 0 to return to the starf, step 1 31 3. If the mailbox number is valid, a message 
such as "Record your message alter the tone," is played, step 1304. 

20 a newfile is created on the file server with afile name that is uniquely created which has ".vox" as its last 4 characters, 

and the system transfers the digitized voice signal Irom the user to this file, step 1305. The user indicates he is finished 
recording by entering a #, step 1 306. Next, the VIMCreateMessage subroutine is used to create a new message, step 
1308. Thereupon, step 1308 is performed. In step 1309, the VIMSetMessageHeader subroutine is used to add infor- 
mation to the header of the message. The VIMSetMessageltem subroutine is used to add .VOX file attachments to the 

25 message, step 1 310. The VIMSetMessageRecipient subroutine is used to add the recipient E-mail name to the message, 
step 1 31 1 . Finally, the VIMSendMessage subroutine is used to send the message to its destination, step 1312 

The flowchart of Figure 14 shows the steps for a call answering voice message operation using VIM. The called 
party's extension is forwarded to the voice message system ports and the PBX provides integration information along 
with the call giving the called parly's extension number. Starting with step 1401, the extension number received from 

so the PBX is used to find the called parry's E-mail name from the User Table. In step 1402, the system plays a personal 
greeting previously recorded by the user of the called extension (or a default message if none is recorded - such as 
"Extension xxxx did not answer"). Step 1 403 shows the creation ol a new file name with a .vox extension (to indicate it 
is a voice file) and the writing ol digitized voice data into the file. Recording is terminated when the user hangs-up or on 
the detection of silence, special tones, or a timeout and control proceeds to step 1404. 

35 if the forwarded call is from another extension on the same PBX, some PBX integrations also give the calling parry's 

extension number as well as the called party's extension. Step 1404 checks to see if the caller extension has an entry 
in the User Table. In Step 1405, the decision is made to go to step 1412 if there is an entry and it is a known user, or to 
1406 if it is not. In step 1412, the cc:Mail Import utility is used with the administrator password to create message from 
Caller or equivalent VIM functions. In step 1 406, VIMOpenSession is used to create a newsession using a default name 

40 and password as described previously for MAPI. The flow then goes to step 1 407 to use VIMCreateMessage to create 
a new E-mail message. VIMSetMessageHeader is used to add information to the header of the message, step 1408. 
VIMSetMessageltem is then used to add the vox voice file to the message, step 1409. In the next step of 1410, VIM- 
SetMessageRecipient is used to add the recipient's E-mail name (i.e., address) to the message. In step 1411 , VIMSend- 
Message is used to send the message to the recipients mailbox. 

45 Figure 1 5 is a flowchart showing the steps for marking as read and deleting messages for a VIM type E-mail system. 

In step 1501, the caller issues instructions to mark a message as read or to delete a message. The VIMOpenMessage- 
Container subroutine is used to open the Inbox of the caller, step 1502. One of two different subroutine calls is made, 
depending upon the instructions issued by the caller, step 1503. If the user wishes to mark a message as read, a call 
is made to the VIMMarkMessageAsRead subroutine. If Ihe caller wishes to delete a message, a call is made to the 

so VIMRemoveMessage subroutine. Lastly, in step 1504, the VIMCIoseMessageContainer subroutine is used to close the 
Inbox of the caller. 

Figure 1 6 is a flowchart showing the steps lor replying to a message during message playback for VIM applications. 
Initially, a determination is made as to whether the original sender is known, step 1601 . If so, the process jumps to step 
1606. Otherwise, step 1602 prompts the user is prompted to "Please enterthe Mailbox Number." In step 1603, the caller 
£5 enters the voice mailbox number of the recipient. The user name is then located from the user table, step 1 604. If it is 
an invalid mailbox number, step 1605 informs the user, "Sorry that is not a valid Mailbox Number. Press * to try again 
or 0 to return to the start." And step 1602 is repeated. If the mailbox number is valid, step 1606 gives a personal prompt. 
If this does not exist, the computer transmits, "Please leave your message after the tone." In step 1607, a new .vox file 
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is created, and the digitized voice is written to it. The sender's and recipient's names are located from the user table, 
step 1608. 

The VIMCreateMessage subroutine is used to create a new message, step 1609. VIMSetMessageHeader is used 
to add a subject text to the header of the message, step 1610. In step 1611 , VIMSetMessageltem is used to add the .vox 

5 file attachment to the message. The VIMSetMessageRecipient subroutine is used to add the recipient's name to the 
message, step 1612. Finally, the VIMSendMessage subroutine is used to send the message to its destination. 

By implementing API subroutine calls as described in the flowcharts of Figures 2-16 with the network of Figure 1, 
and especially in light of Table 1 , the implementation of a traditional voice message system using E-mail as the directory, 
security, and message handling mechanism is achieved. These traditional features included call answering and taking 

io a message, logging on to a voice mailbox and creating and sending a voice message to a specific user, saving, and 
erasing messages, verifying security codes, and playing back messages to a user who has called in from a telephone 
to retrieve the messages. Other prior art voice message features such as reply and forward could also be implemented 
by one skilled in the art using the appropriate E-mail API functions that provide the corresponding operations. 

As previously indicated the invention also includes features implemented in software at the PC or workstation on 

15 the LAN. As indicated in Table 1, these operations also use some of the E-Mail APIs for implementing their operation 
and some of the capabilities of the Microsoft Windows™ software. These operations will be explained by referring to 
Figure 17. 

Figure 17 shows a PC Windows screen showing two windows. The top one, window 1700, is the screen showing 
the control specific to handling voice messages. The bottom one, window 1 720. is the screen for a typical E-mail system. 
20 Numerous "buttons" are shown, 1701-1710 and 1722-1726, which are typically selected using a computer mouse or 
trackball. 

As an example of the operation of selecting a voicemail message to be played, the user would select (click-on twice) 
message 1727. Because the attachment has a .vox extension, the Windows™ software will have been set up to activate 
a special application which will send a command to the voice gateway PC to tell it to use a telephone line to call the 

25 extension associated with the PC (e.g., Extension # 24 in this case). When the user answers, he can use the controls 
in window 1700 to control the playback of the message (e.g., contained in file EXT_3521.VOX). Button 1706 is used to 
back up 10 seconds in the message and start playing from there. Button 1707 is used to back up and start playing from 
the beginning. Button 1708 stops playing and 1709 starts playing. Button 1710 skips forward 10 seconds. All the functions 
of buttons 1707-1710 are similar to the functions available to the known prior art voicemail systems except they use 

30 buttons on the screen rather than buttons on a phone. The commands are sent to the voice gateway PC via the LAN. 
Display 1713 shows how much of the voice message has been played and display 1714 shows its total length (in 
seconds). Button 1712 is used to force a hang-up of the telephone line from the voice gateway to the PBX when the 
user is finished. Display 1711 shows the name of the voice file being played. 

In order to send a voice message to another user, the PC user would select the Record button 1704. For example, 

35 this would send a command to the voice gateway causing it to use a telephone line to call the extension number 24. 
When the user answers, he can use the tape recorder controls to start and stop recording and to playback what he has 
already recorded. As for play, these functions are implemented via commands from the PC via Ihe LAN to the gateway 
and correspond to the prior art voice messaging functions used from a telephone and are similarly implemented. When 
the user is finished recording and wishes to send the message, he selects button 1705 (i.e., Mail). This uses the 

40 MAPISendDocuments or SMISendMail subroutine from MAPI or VIM to launch the E-mail application which will allow 
the user to address and send the message using the E-mail address collection screen. The recorded .vox voice file 
name is passed to the E-mail system to be sent as an attachment to the E-mail message. 

The Dialer button 1701 has nothing to do with voice messaging. It is provided as a convenience to the user. When 
it is selected, a directory screen is opened, which allows the user to select or enter a phone number to be called. The 

45 number is sent via the LAN to the voice gateway. The voice gateway calls the extension number associated with the 
PC (e.g., in this case, extension 24). When the user answers the extension, the voice gateway PC does a hook-switch 
flash to indicate to the PBX that it wishes to transfer the extension somewhere else. It then dials the phone number 
passed by the PC and hangs-up to complete the call transfer. 

Window 1720 provides a user interface to the E-mail system. Since the present invention integrates the voicemail 

so as part of the E-mail system, window 1720 provides a user interface with voicemail as well. Window 1720 includes a 
list 1721 of messages corresponding to a user's mailbox. List 1721 is broken into four columns. One column identifies 
the party that had sent the message. A second column gives the date that the message was sent. A third column identifies 
the subject of the message. If the message is a voice file, it is indicated as being "Voicemail". The fourth column lists 
any attachments. In the currently preferred embodiment, a user can point-and-click on any of the voice messages or 

55 icons for playback of that message. 

Five buttons 1 722-1 726 are also displayed by window 1 720. The Read button 1 722 allows a user to read text files 
(i.e., the E-mail messages). The Reply button 1723 lets the user reply to a received message, wherein the reply and 
the received message can be either voice or E-mail messages. The Forward Button 1724 forwards a message to one 
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or more other users. The Delete button 1725 deletes selected messages. The Print button 1726 produces a hard copy 
of a selected text file. 

The operation of the invention to provide wide area voice messaging networking is entirely based on the E-mail 
system's wide area networking system. That is, commercially available E-mail systems such as Microsoft Mail™ and 
Lotus cc:Mail™ support the ability to send E-mail systems to users located on different LANs in locations throughout 
the world. These systems also support automatic directory update programs which propagate directory updates between 
these different LAN systems automatically. Because the voice messaging systems in voice files are attached to an E-mail 
message, they will be transferred to a wide area network of other systems just the same as regular E-mail. As described 
above : the E-mail directory is modified to add a mailbox address and an extension number. Thereupon it is scanned to 
build a User Table. In order to support wide area networking, as is offered in traditional voicemail systems, it is necessary 
to ensure that the mailbox addresses for each LAN system is unique across the entire wide area network. This can be 
achieved, for example, by assigning each LAN an additional three-digit location code that is attached to the front of the 
local user mailbox number. A user who receives an E-mail message with a voice message via a WAN, can play the 
voice message if there is an attached voice gateway PC. It is also possible to provide sottware on the PC which will 
convert the voice file from the voice encoding scheme provided by the voice boards in a PC gateway to the encoding 
used by voice boards (e.g., those made by SoundBlaster™ Inc.) in the desktop PC and thus play the voice through a 
speaker associated with the desktop PC. Note that it is also possible to take speech recorded by a microphone to a PC 
voice board and also to convert voice files to the encoding scheme used by the voice boards in the PC gateway for 
playing messages recorded on the PC over the phone lines. 

Although the preferred embodiment of the invention uses VIM and MAPI for its implementation, there may evolve 
new E-mail APIs that would allow a similar implementation. Consequently, this disclosure is not meant to narrow the 
invention by showing the use of the VIM and MAPI examples. Further, it would be possible to design and implement an 
E-mail and a voice message system at the same time, both using the same directory and message handling systems. 
In other words, the voice messaging could be integrated into the E-mail function or vice versa by a company that has 
an existing E-mail or voice messaging system. The methods for doing this would be obvious to one skilled in the art 
based upon this disclosure. 

Thus, an integrated voice and electronic mailing system is disclosed. 

Claims 

1. An integrated text and voice messaging system, comprising: 

a plurality of personal computers (107, 108, 109) coupled together for receiving and sending messages and 
for inputting commands to control said integrated text and voice messaging system; 

a plurality of telephones (101a, 101b, 101c) associated with said plurality of personal computers (107, 108, 
109. ) for playing and recording voice messages, wherein said plurality of telephones (101a, 101b, 101c) are 
coupled to a telephone switching system (102); 

a voice gateway computer (103) coupled to said switching system (102) and said personal computers (107, 
108, 109), said voice gateway computer (103) including voice processing circuits for converting voice signals 
to digital data and also converting said digital data to said voice signals; 

a plurality of telephone trunk lines (110, 111, 112) connected to said switching system (102) in order to connect 
to said voice gateway computer (103) for providing remote telephone access for entering commands from a 
remote telephone; 

a data server computer (106, 106b) coupled to said plurality of personal computers (107, 108, 109) for storing 
data accessible from said plurality of personal computers (107, 108, 109) and said voice gateway computer 
(103); 

a plurality of shared files stored on said data server computer (106, 106b) containing information regarding both 
text and voice messaging; 

characterized by a plurality of addresses, each of said addresses specifying a single mail box where said voice 
and said text messages are to be stored for a user of the system. 

2. The integrated text and voice messaging system of Claim 1 further comprising a means for limiting access to said 
text and voice message system to a user from said remote telephone only upon entering a valid password stored 
by said plurality of shared files, wherein said password gains access to both text and voice messages. 

3. The integrated text and voice messaging system ol Claim 1 wherein said data server computer comprises a mailbox 
corresponding to each user and said messages having either a textual or a voice format are stored according to a 
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recipient's mailbox. 

4. The integrated text and voice messaging system of Claim 3 further comprising: 

a means for converting a voice message to a digital voice file: 

a means for attaching said digital voice file to an electronic mailing document so that said voice file can be 
accessed through said mailbox. 

5. The integrated text and voice messaging system of Claim 4 further comprising: 

a means for accessing said mailbox for counting a number of voice Ales in said mailbox; 

a means for informing said number of said voice files corresponding to said mailbox to said user of said remote 

telephone. 

6. The integrated text and voice messaging system of Claim 5, wherein said informing means also informs the user 
of a number of new voice files and a number of saved voice files. 

7. The integrated text and voice messaging system of Claim 1, wherein said commands from said remote telephone 
include saving, erasing, replying, and forwarding of a selected voice message. 

8. The integrated text and voice messaging system of Claim 1 further comprising a single directory containing infor- 
mation regarding a user's E-mail address, voice mail address, and extension number. 

9. A method of integrating voice messages with text messages in an electronic mailing system, wherein a message 
handling mechanism handles both voice and text files corresponding to said voice and text messages, said method 
characterized by the steps of: 

utilizing a directory which contains a plurality of addresses, each of said addresses specifying a single mail box 
where said voice and said text messages are to be stored for a user of said integrated text and voice messaging 
system; 

accessing the electronic mailing system through a telephone; 

receiving commands from said telephone for controlling said electronic mailing system. 

1 0. The method of Claim 9 further comprising the steps of: 

recording a voice message as a digital voice file; 

entering one of said addresses from said telephone corresponding to said single mailbox; 
updating said mailbox with information regarding said voice file. 

11. The method of Claim 10, wherein said commands include a command for playing a voice message stored in said 
mailbox over said telephone. 

12. The method of Claim 10 wherein said commands include a command for erasing a voice message stored in said 
mailbox. 

13. The method of Claim 10 wherein said commands include a command for saving a voice message stored in said 
mailbox. 

1 4. The method of Claim 1 0 wherein said commands include a command for forwarding a voice message stored in said 
mailbox. 

1 5. The method of Claim 1 0 wherein said commands include a command for replying to a voice message stored in said 
mailbox. 

16. The method of Claim 10 further comprising the step of storing a security code which grants access to both text 
messages and voice messages of a particular mailbox. 

17. The method of Claim 10 further comprising the steps of: 
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accessing said mailbox to determine a number of voice files in said mailbox; 
informing a user of said telephone of said number of voice files in said mailbox. 

18. A method of integrating voice messages with text messages in an electronic mailing system characterized by the 
steps of: 

utilizing a directory which contains a plurality of addresses, each of said addresses specifying a single mailbox 
where said voice messages and said text messages are to be stored for a user of said integrated text and voice 
messaging system: 

receiving a forwarded incoming telephone call; 
determining a called party's extension number; 

recording a voice message trom said incoming telephone call as a digital voice file; 
determining said single mailbox address from said extension number; 
updating said mailbox with information regarding said voice file 



Patentanspruche 

1 . Integriertes Text- und Sprachnachrichtensystem, umfassend: 

eine Vielzahl von miteinander gekoppelten Personal Computern (107, 108, 109) zum Empfangen und Senden 
von Nachrichten und zur Eingabe von Befehlen zur Steuerung des integrierten Text- und Sprachnachrichten- 
systems; 

eine Vielzahl von zur Vielzahl der Personal Computer (1 07, 108, 1 09) gehorigen Telephonen (1 01 a, 1 01 b, 1 01 c) 
zur Wiedergabe und Aufzeichnung von Sprachnachrichten, wobei die Vielzahl der Telephone (101a, 101b, 
101c) mit einem Telephon-Vermittlungsystem (102) gekoppelt sind; 

einen mit dem Vermittlungssystem (102) und den Personal Computern (107, 108, 109) gekoppelten 
Sprach-Gateway-Computer (103), wobei der Sprach-Gateway-Computer (103) Sprachverarbeitungsschaltun- 
gen zur Wandlung von Sprachsignalen zu digitalen Daten sowie zur Wandlung von digitalen Daten zu Sprach- 
signalen enthalt; 

eine Vielzahl von Telephonverbindungsleitungen (110, 111, 112), die mit dem Vermittlungssystem (102) zum 
AnschluB des Sprach-Gateway-Computers (103) gekoppelt sind, urn einen Fern-Telephonzugriff zur Eingabe 
von Befehlen von einem entfernten Telephon aus bereitzustellen: 

einen mit der Vielzahl der Personal Computer (1 07, 1 08, 1 09) gekoppelten Daten-Server-Computer (1 06, 1 06b) 
zum Speichem von Daten, auf die uber eine Vielzahl von Personal Computern (107, 108, 109) und den 
Sprach-Gateway-Computer (103) zugegriffen werden kann; 

eine Vielzahl in dem Daten-Server-Computer (106, 106b) gespeicherter gemeinsam genutzter Dateien, die 
Informationen sowohl hinsichtlich der Text- als auch der Sprachnachrichten enthalten, 
gekennzeichnet durch 

eine Vielzahl von Adressen, wobei jede dieser Adressen eine einzelne Mailbox angibt, in der die Sprach- und 
Textnachrichten fur einen Systembenutzer zu speichern sind. 

2. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 1 , des weiteren eine Einrichtung fur den begrenz- 
ten Zugriff auf das Text- und Sprachnachrichtensystem durch einen Benutzer von einem entfernten Telephon aus 
nur durch Eingabe eines gultigen PaBwortes, das in der Vielzahl der gemeinsam genutzten Dateien abgespeichert 
ist, wodurch das PaBwort den Zugriff sowohl auf die Text- als auch auf die Sprachnachrichten ermoglicht, umfas- 
send. 

3. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 1 , in dem der Daten-Server-Computer eine jedem 
Benutzer entsprechende Mailbox umlaBt, und die Nachrichten in entweder Text- oder Sprachformat entsprechend 
einer Mailbox eines Empfangers gespeichert werden. 

4. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 3, des weiteren umfassend: 

eine Einrichtung zur Wandlung einer Sprachnachricht zu einer digitalen Sprachdatei; 

eine Einrichtung zum AnschlieBen der digitalen Sprachdatei an ein elektronisches Post- bzw. Mailing-Doku- 
ment, so daB auf die Sprachdatei uber die Mailbox zugegriffen werden kann. 
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5. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 4, des weiteren umfassend: 

eine Einrichtung fur den Zugriff auf die Mailbox zur Zahlung der Anzahl der in der Mailbox befindlichen Sprach- 
dateien; 

eine Einrichtung zur Information des Benutzers des entfernten Telephons Ober die Anzahl der der Mailbox 
entsprechenden Sprachdateien. 

G. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 5, bei dem die Informationseinrichtung den 
Benutzer auBerdem uber die Anzahl neuer Sprachdateien und die Anzahl gesicherter Sprachdateien informiert. 

7. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 1 , bei dem die Befehle von dem entfernten Tele- 
phon Sichern, Loschen, Beantworten und Weiterleiten einer ausgewahlten Sprachnachricht enthalten. 

8. Integriertes Text- und Sprachnachrichtensystem gemaB Anspruch 1 , des weiteren ein einziges Verzeichnis mit Infor- 
mationen hinsichtlich der E-Mail- bzw. elektronischen Post-Adresse, der Sprachinformations-Adresse und der 
Nebenstellennummer eines Benutzers umfassend. 

9. Verfahren zur Integration von Sprachnachrichten mit Textnachrichten in einem elektronischen Postsystem, bei dem 
ein Nachrichten-Abwicklungsmechanismus sowohl Sprach- als auch Textdateien entsprechend den Sprach- und 
Textnachrichten abwickelt, wobei das Verfahren durch folgende Schritte gekennzeichnet ist 

Heranziehen eines Verzeichnisses, das eine Vielzahl von Adressen enthalt. wobei jede dieser Adressen eine 
einzige Mailbox angibt, in der die Sprach- und Textnachrichten fur einen Benutzer des integrierten Text- und 
Sprachnachrichtensystems zu speichem sind; 
Zugreifen auf das elektronische Postsystem uber ein Telephon; 

Empfangen von Befehlen von diesem Telephon zur Steuerung des elektronischen Postsystems. 

10. Verfahren gemaB Anspruch 9 : des weiteren folgende Schritte umfassend: 

Aufzeichnen einer Sprachnachricht als digitale Sprachdatei; 

Eingeben einer der Adressen entsprechend einer einzelnen Mailbox uber das Telephon; 
Aktualisieren dieser Mailbox mit Informationen hinsichtlich dieser Sprachdatei. 

11. Verfahren gemaB Anspruch 10, bei dem die Befehle einen Befehl zur Wiedergabe einer in dieser Mailbox gespei- 
cherten Sprachnachricht uber dieses Telephon enthalten. 

12. Verfahren gemaB Anspruch 10, bei dem die Befehle einen Befehl zum Loschen einer in dieser Mailbox gespeicher- 
ten Sprachnachricht enthalten. 

13. Verfahren gemaB Anspruch 10, bei dem die Befehle einen Befehl zur Sicherung einer in dieser Mailbox gespei- 
cherten Sprachnachricht enthalten. 

14. Verfahren gemaB Anspruch 10, bei dem die Befehle einen Befehl zum Weiterleiten einer in dieser Mailbox gespei- 
cherten Sprachnachricht enthalten. 

15. Verfahren gemaB Anspruch 10, bei dem die Befehle einen Befehl zur Beantwortung einer in dieser Mailbox gespei- 
cherten Sprachnachricht enthalten. 

16. Verfahren gemaB Anspruch 10, des weiteren den Schritt der Speicherung eines Sicherheitscodes, der den Zugriff 
sowohl auf Text- als auch auf Sprachnachrichten in einer bestimmten Mailbox gewahrt. 

17. Verfahren gemaB Anspruch 10, des weiteren folgende Schritte umfassend: 

Zugreifen auf diese Mailbox zur Bestimmung der Anzahl von Sprachdateien in dieser Mailbox; 
Informieren des Benutzers dieses Telephons uber die Anzahl der Sprachdateien in dieser Mailbox. 

1 8. Verfahren zur Integration von Sprachnachrichten mit Textnachrichten in einem elektronischen Postsystem, gekenn- 
zeichnet durch folgende Schritte: 
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Heranziehen eines Verzeichnisses, das eine Vielzahl von Adressen enthalt, wobei jede dieser Adressen eine 

einzige Mailbox angibl, in der die Sprach- und Textnachrichten fur einen Benutzer des integrierten Text- und 

Sprachnachrichtensystems zu speichern sind; 

Empfangen eines weitergeleiteten, eingehenden Telephonanrufs; 

Beslimmen der Nebenstellennummer der angerufenen Partei: 

Aufzeichnen einer Sprachnachricht des eingehenden Telephonanrufs als digitale Sprachdatei; 
Bestimmen der Adresse dieser einen Mailbox anhand der Nebenstellennummer; 
Aktualisieren der Mailbox mit Informationen hinsichtlich dieser Sprachdatei. 

Revendications 

1. Systeme integr6 de messagerie de I'ecrit et de messagerie vocale comprenant : 

une pluralite d'ordinateurs personnels (1 07, 1 08, 1 09) couples entre eux pour recevoir et envoyer des messages 
et pour entrer des commandes afin de commander ledit systeme integre de messagerie de I'ecrit et de mes- 
sagerie vocale; 

une pluralite de telephones (101a, 101b, 101c) associes a fadite pluralite d'ordinateurs personnels (107, 108, 
109), pour reslitueret enregistrer des messages vocaux, dans lequel ladite pluralite de telephones (101a, 101b, 
101c) est couplee a un systeme de commutation telephonique (102); 

un ordinateur de passerelle vocale (103) couple audit systeme de commutation (102) et auxdits ordinateurs 
personnels (107, 108, 109), ledit ordinateur de passerelle vocale (103) comprenant des circuits detraitement 
vocal pour convertir des signaux vocaux en des donnees numeriques et convertir egalement lesdites donnees 
numeriques en lesdits signaux vocaux ; 

une pluralite de lignes telephoniques de jonction (110, 111, 112) connectees audit systeme de commutation 
(102) en vue de connecter ledit ordinateur de passerelle vocale (103) afin de fournir un acces telephonique a 
distance pour entrer des commandes a partir d'un telephone distant ; 

un ordinateur formant serveur de donnees (106, 106b) couple a ladite pluralite d'ordinateurs personnels (107, 
108, 109) pour stocker des donnees accessibles depuis ladite pluralite d'ordinateurs personnels (107, 108, 
109) et ledit ordinateur de passerelle vocale (103) ; 

une pluralite de fichiers partages, stockes sur ledit ordinateur de serveur de donnees (106, 106b), contenant 
des informations concernant a la fois la messagerie de I'ecrit et de messagerie vocale, 

caracterise par une pluralite d'adresses, chacune desdites adresses specifiant une boTte postale unique dans 
laquelle lesdits messages vocaux et lesdits messages ecrits doivent etre stockes pour un utilisateur du systeme. 

2. Systeme integre de messagerie de I'ecrit et de messagerie vocale selon la revendication 1, comprenant en outre 
un moyen pour n'autoriser I'acces audit systeme integre de messagerie de I'ecrit et de messagerie vocale par un 
utilisateur, a partir dudit telephone distant, uniquement qu'apres Pentree d'un mot de passe valide stocke par ladite 
pluralite de fichiers partages, dans lequel ledit mot de passe donne un acces a la fois aux messages ecrits et aux 
messages vocaux. 

3. Systeme integre de messagerie de I'ecrit et de messagerie vocale selon la revendication 1 , dans lequel ledit ordi- 
naleur de serveur de donnees comprend une botte postale correspondant a chaque utilisateur et lesdits messages 
presentant un format de I'ecrit ou un format vocal sont stockes selon une bolte postale d'un destinataire. 

4. Systeme integre de messagerie de I'ecrit et de messagerie vocale selon la revendication 3, comprenant en outre 
un moyen pour convertir un message vocal en un fichier vocal numerique ; 

un moyen pour fixer ledit fichier vocal numerique a un document postal electronique de maniere que Ton puisse 
acceder audit fichier vocal par I'intermediaire de ladite bolte postale. 

5. Systeme integre de messagerie de I'ecrit et de messagerie vocale selon la revendication 4, comprenant en outre : 
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un moyen pour acceder a ladite boite postale pour compter le nombre de fichiers vocaux dans ladite botte 
postale ; 

un moyen pour fournir une information concernant ledit nombre desdits fichiers vocaux, correspondent a ladite 
boite vocale, audit utilisateur dudit telephone distant. 

6. Systeme integre de messagerie de I'ecrit et de messagerie vocale selon la revendication 5, dans lequel ledit moyen 
d'information informe egalement I'utilisateurdu nombre denouveaux fichiers vocaux etdu nombre de fichiers vocaux 
sauvegardes. 

7. Systeme integre de messagerie de I'ecrit et de messagerie vocale selon la revendication 1, dans lequel lesdites 
commandes provenant dudit telephone distant comprennent la sauvegarde : I'effacement, la reponse et la trans- 
mission d'un message vocal selectionne. 

8. Systeme integr6 de messagerie de I'ecrit et de messagerie vocale selon la revendication 1 , comprenant en outre 
un annuaire unique contenant des informations concernant I'adresse de messagerie electronique d'un utilisateur, 
une adresse de boTte vocale et un numero de poste. 

9. Procede d'integration de messages vocaux dans des messages de I'ecrit dans un systeme de messagerie electro- 
nique, dans lequel un mecanisme de traitement de messages traite a la fois des fichiers vocaux et des fichiers de 
I'ecrit correspondant auxdits messages vocaux et messages de I'ecrit, ledit procede etant caracterise par les etapes 
dans lesquelles : 

on utilise un annuaire qui contient une plurality d'adresses, chacune desdites adresses specifiant une botte 
postale unique dans laquelle lesdits messages vocaux et messages de I'ecrit doivent §tre stockes pour un 
utilisateur dudit systeme integre de messagerie de I'ecrit et de messagerie vocale ; 

on accede au systeme de messagerie electronique via un telephone ; 

on recoit des commandes depuis ledit telephone pour commander ledit systeme de messagerie electronique. 

10. Procede selon la revendication 9 ; comprenant en outre les etapes : 

d'enregistrement d'un message vocal sous forme de fichier vocal numerique ; 

entree de I'une des adresses, depuis ledit telephone, correspondant a ladite boite postale unique ; 

mise a jour de ladite boite postale avec des informations concernant ledit fichier vocal. 

11. Procede selon la revendication 10, dans lequel lesdites commandes comprennent une commande pour lire un 
message vocal, stocke dans ladite boite postale, avec ledit telephone. 

12. Procede selon la revendication 10, dans lequel lesdites commandes comprennent une commande pour effacer un 
message vocal stocke dans ladite boite postale. 

1 3. Procede selon la revendication 1 0, dans lequel lesdites commandes comprennent une commande pou r sauvegarder 
un message vocal stocke dans ladite boite postale. 

14. Procede selon la revendication 10, dans lequel lesdites commandes comprennent une commande pourtransmettre 
un message vocal stocke dans ladite boite postale. 

15. Procede selon la revendication 10, dans lequel lesdites commandes comprennent une commande pour repondre 
a un message vocal stocke dans ladite boite postale. 

16. Procede selon la revendication 10, comprenant en outre I'etape de stockage d'un code de securite qui alloue un 
acces a la fois aux messages de I'ecrit et aux messages vocaux d'une boite postale particuliere. 

17. Procede selon la revendication 10, comprenant en outre les etapes dans lesquelles : 
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on accede a ladite boTte postale pour determiner !e nombre de fichiers vocaux contenus dans ladite boTte 
postale ; 

on informe un utilisateur dudit telephone dudit nombre de fichiers vocaux de ladite boTte postale. 

18. Procede d'integration de messages vocaux avec des messages de I'ecrit dans un systeme de messagerie electro- 
nique, caracterise par les etapes dans lesquelles : 

on utilise un annuaire qui contient une pluralite d'adresses, chacune desdites adresses specifiant une boTte 
postale unique dans laquelle lesdits messages vocaux et lesdits messages de I'ecrit doivent etre stockes pour 
un utilisateur dudit systeme intdgre de messagerie de I'ecrit et de messagerie vocale ; 

on recpit un appel telephonique entrant transmis ; 

on determine un numero de poste d'un appele ; 

on enregistre un message vocal a partir dudit appel telephonique entrant sous forme de fichier vocal numerique ; 
on determine ladite adresse de boTte postale unique, a partir dudit numero de poste ; 
on met a jour ladite boTte postale avec des informations concernant ledit fichier vocal. 
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